Mass detection on mammograms: signal variations and performance changes for human and model observers

We studied the influence of signal variability on human and model observer performances for a detection task with mammographic backgrounds and computer generated clustered lumpy backgrounds (CLB). We used synthetic yet realistic masses and backgrounds that have been validated by radiologists during previous studies, ensuring conditions close to the clinical situation. Four trained non-physician observers participated in two-alternative forced-choice (2-AFC) experiments. They were asked to detect synthetic masses superimposed on real mammographic backgrounds or CLB. Separate experiments were conducted with sets of benign and malignant masses. Results under the signal-known-exactly (SKE) paradigm were compared with signal-known-statistically (SKS) experiments. In the latter case, the signal was chosen randomly for each of the 1,400 2-AFC trials (image pairs) among a set of 50 masses with similar dimensions, and the observers did not know which signal was present. Human observers' results were then compared with model observers (channelized Hotelling with Difference-of-Gaussian and Gabor channels) in the same experimental conditions. Results show that the performance of the human observers does not differ significantly when benign masses are superimposed on real images or on CLB with locally matched gray level mean and standard deviation. For both benign and malignant masses, the performance does not differ significantly between SKE and SKS experiments, when the signals' dimensions do not vary throughout the experiment. However, there is a performance drop when the SKS signals' dimensions vary from 5.5 to 9.5 mm in the same experiment. Noise level in the model observers can be adjusted to reproduce human observers' proportion of correct answers in the 2-AFC task within 5% accuracy for most condition

Theoretical Evaluation of the Detectability of Random Lesions in Bayesian Emission Reconstruction

Detecting cancerous lesion is an important task in positron emission tomography (PET). Bayesian methods based on the maximum a posteriori principle (also called penalized maximum likelihood methods) have been developed to deal with the low signal to noise ratio in the emission data. Similar to the filter cut-off frequency in the filtered backprojection method, the prior parameters in Bayesian reconstruction control the resolution and noise trade-off and hence affect detectability of lesions in reconstructed images. Bayesian reconstructions are difficult to analyze because the resolution and noise properties are nonlinear and object-dependent. Most research has been based on Monte Carlo simulations, which are very time consuming. Building on the recent progress on the theoretical analysis of image properties of statistical reconstructions and the development of numerical observers, here we develop a theoretical approach for fast computation of lesion detectability in Bayesian reconstruction. The results can be used to choose the optimum hyperparameter for the maximum lesion detectability. New in this work is the use of theoretical expressions that explicitly model the statistical variation of the lesion and background without assuming that the object variation is (locally) stationary. The theoretical results are validated using Monte Carlo simulations. The comparisons show good agreement between the theoretical predications and the Monte Carlo results

Visual signal detection in structured backgrounds. IV. Figures of merit for model performance in multiple-alternative forced-choice detection tasks with correlated responses.

Many investigators are currently developing models to predict human performance in detecting a signal embedded in complex backgrounds. A common figure of merit for model performance is d', an index of detectability that can be mathematically related to the proportion correct (Pc) when the responses of the model are Gaussian distributed and statistically independent. However, in many multiple-alternative forced-choice (MAFC) detection tasks, the target appears in one of M different locations within an image. If the image contains slow spatially varying luminance changes (low-pass noise), the pixel luminance values at the possible signal locations are correlated and therefore the model/human responses to the different locations might also be correlated. We investigate the effect of response correlations on model performance and compare different figures of merit for these conditions. Our results show that use of the standard d' index of detectability assuming statistical independence can lead to erroneous underestimates of Pc and misleading comparisons of models. We introduce a novel figure of merit d'(r) that takes into account response correlations and can be used to accurately estimate Pc. Furthermore, we show that d'(r) can be readily related to the standard index of detectability d' by d'(r) = d'/square root of (1 - r), where r is the correlation between the responses in any MAFC detection task. We illustrate the use of the theory by computing figures of merit for two linear models detecting a signal in one of four locations within medical image backgrounds

Visual signal detection in structured backgrounds. III. Calculation of figures of merit for model observers in statistically nonstationary backgrounds.

Models of human visual detection have been successfully used in computer-generated noise. For these backgrounds, which are generally statistically stationary, model performance can be readily calculated by computing the index of detectability d' from the noise power spectrum, the signal profile, and the model template. However, model observers are ultimately needed in more real backgrounds, which may be statistically non-stationary. We investigated different methods to calculate figures of merit for model observers in real backgrounds based on different assumptions about image stationarity. We computed performance of the nonpre-whitening matched-filter observer with an eye filter on mammography and coronary angiography for an additive or a multiplicative signal. Performance was measured either by applying the model template to the images or by computing closed-form expressions with various assumptions about image stationarity. Results show first that the structured backgrounds investigated cannot be considered stationary. Second, traditional closed-form expressions of detectability calculated from the noise power spectra with the assumption of background stationarity lead to erroneous estimates of model performance. Third, the most accurate way of measuring model performances is by directly applying the model template on the images or by computing a closed-form expression that does not assume image stationarity

Impact of bone suppression imaging on the detection of lung nodules in chest radiographs: Analysis of multiple reading sessions

Item does not contain fulltextMedical Imaging 2013: Image Perception, Observer Performance, and Technology Assessment, Lake Buena Vista (Orlando Area), Florida, USA | February 9, 201

Channelized Hotelling observer correlation with human observers for low-contrast detection in liver CT images.

Task-based image quality procedures in CT that substitute a human observer with a model observer usually use single-slice images with uniform backgrounds from homogeneous phantoms. However, anatomical structures and inhomogeneities in organs generate noise that can affect the detection performance of human observers. The purpose of this work was to assess the impact of background type, uniform or liver, and the viewing modality, single- or multislice, on the detection performance of human and model observers. We collected abdominal CT scans from patients and homogeneous phantom scans in which we digitally inserted low-contrast signals that mimicked a liver lesion. We ran a rating experiment with the two background conditions with three signal sizes and three human observers presenting images in two reading modalities: single- and multislice. In addition, channelized Hotelling observers (CHO) for single- and multislice detection were implemented and evaluated according to their degree of correlation with the human observer performance. For human observers, there was a small but significant improvement in performance with multislice compared to the single-slice viewing mode. Our data did not reveal a significant difference between uniform and anatomical backgrounds. Model observers demonstrated a good correlation with human observers for both viewing modalities. Human observers have very similar performances in both multi- and single-slice viewing mode. It is therefore preferable to use single-slice CHO as this model is computationally more tractable than multislice CHO. However, using images from a homogeneous phantom can result in overestimating image quality as CHO performance tends to be higher in uniform than anatomical backgrounds, while human observers have similar detection performances